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Abstract 


Multisets are an intuitive extension of the traditional concept of sets that allows repetition of elements, with the 





number of times each element appears being understood as the respective multiplicity. The recent generalization of 


multisets to real-valued functions, accounting for possibly negative values, has paved the way to a number of interesting 


implications and applications. The basic multiset operations include the set complementation (sign change), intersection 


(minimum between two values), union (maximum between two values), difference and sum (identical to the algebraic 


counterparts). When applied to functions or signals, the sign and conjoint sign functions are also required. Given that 


signals are functions, it becomes possible to translate the multiset and multifunction operations to electronics, which 


is the objective of the present work. It is proposed that effective multiset operations capable of high performance self 


and cross-correlation can be obtained with relative simplicity in either discrete or integrated circuits. The problem 


of switching noise is also briefly discussed. The present results have great potential for applications and related 


developments in analog and digital electronics, as well as for pattern recognition and signal processing. 


“Ts there a limit to electronics magic?” 


LdaFC 


1 Introduction 


Electronics and signal processing, especially in their linear 
modalities, have largely relied on the algebraic operations 
of sum, subtraction, and product of signals. Filtering, 
self- and cross correlations are just some examples of the 
interesting applications of linear signal processing (e.g. |1, 
2, 3|) and electronics (e.g. [4, 5, 6]). 

Multisets (e.g. [7, 8, 9, 10, 11, 12]) corresponds to an in- 
teresting and conceptually powerful extension of set the- 





ory that allows repeated elements to be taken into ac- 
count. In a sense, multiset theory seems to be even more 
compatible with human intuition than the now classic set 
theory. 

While multisets had been mostly applied to categorical 
or non-negative values, they can be generalized to real val- 
ues, including possibly negative values |13, 14, 15]. This 





can be achieved by allowing the multiset difference oper- 
ation to lead to negative multiplicities, which implies the 
universe multiset to be identical to the empty multiset, 
therefore establishing a stable complement operation. 
Real-value multisets have been further generalized to 


real function spaces, allowing the integration of multiset 
concepts and properties with all the algebraic operations, 
so that hybrid expressions such as: 


[f (t) U gJ] cos(h(t) U —g(t)) 


can be obtained [14, 15]. When applied to real function 
spaces, multisets have been called multifunctions, while 
their image whiles are associated with the real-valued 
multisets multiplicities. 

These generalizations paved the way to a wide range 
of possible developments and applications in the most di- 
verse areas. For instance, it has been shown that the 
common product between two functions provides sub- 
stantially enhanced potential for performing filtering and 
pattern recognition operations, including template match- 
ing [14, 16]. 

More specifically, not only sharper and narrower match- 
ing peaks are obtained at the same time as secondary 





matches and noise are effectively eliminated. These de- 
sirable features stem from the fact that, though involv- 





ing the extremely simple operations as the minimum and 
maximum binary operations (in the sense of taking two 
arguments), the common product as well as several multi- 
function operations are ultimately non-linear. Results de- 
rived from these developments have also been found to al- 
low impressive performance for clustering (non-supervised 
pattern recognition) |17| and Complex network represen- 


tations and community finding [18]. 
The present work addresses the application of real- 
valued multisets and multifunctions to the areas of signal 





processing and electronics. There are several motivations 
for doing so. First, we have that the effective implementa- 
tion of operations such as the common product paves the 
way to especially accurate and effective real-time appli- 
cations in several related areas, including pattern recog- 
nition, deep learning, an control systems. Particularly 





promising is the implementation of the suggested elec- 
tronic operators in integrated electronics. Second, the im- 
plementation of the multifunction operations in electronic 
devices paves the way to their effective incorporation into 
the area of signal and image processing. 

After introducing and illustrating some of the main 
multiset/multifunction operations, the common product 
in its elementwise and functional forms, as well as the re- 
spectively obtained correlation methods, are briefly out- 
lined. Subsequently, we propose respective implementa- 
tions in relatively simple electronic circuits involving a 
combination of linear and digital devices, including ana- 
log switches, operational amplifiers, comparators and xor 
logic. A complement implementation of the elementwise 
common product is then proposed and discussed. 


2 Basic Real- Valued Multiset Op- 
erations 


Given a signal f(t), its complement is immediately ob- 
tained as — f (t). 

The sign function of f(t) is henceforth understood to 
corresponds to: 


s(t) = t 


Observe that s(x) f(x) = |f (x). 


Given an additional signal g(t), the intersection be- 


if f(t) 2 0 


otherwise. 


tween these signals can be obtained as: 


ft) aff) < g(t) 
g(t) otherwise. 


min {F(0,0(0} = | 


Similarly, the union between the two signals can be 
expressed as: 


max {f(a} = 4 D IM) © a 


(t) otherwise. 


The conjoint sign function between the signals f(t) and 
g(t) is defined as: 


Sfg(t) = sp(t)5,(t) (1) 


Figure 1 illustrates two considered signals, namely a 
cosine (a) and sine (b) along a complete respective period, 


as well as the associated sign (c-d) and conjoint (e) sign 
functions. 


Shown in Figure 7 are the operations of these real- 
valued multiset operations with respect to two signals f(t) 
and g(t) shown in Figure 1. 


3 The Common Product and Cor- 


relation 


Given two signals f(t) and g(t), their elementwise com- 
mon product |14, 19] can be defined as: 


f(t) o g(t) = spg min {sf Œ) fE), sgt = (2) 


This operation is illustrated in Figure 7(g) with respect 
to the sine and cosine functions. Observe that the respec- 
tive result can be understood as the common region of the 
functions while taking them into account with respect to 
the horizontal axis. 

The common product, corresponding to the functional 
of the elementwise common product in a support region 





S can now be expressed [13, 14, 19] as: 


< FOO >= | sro min {sO FO; DIO} B) 


Observe that, though analogous to the classic inner 
product, this functional is actually non-bilinear, therefore 
not constituting formally an inner product. It is precisely 
the non-linear characteristics of this operation that allow 
its enhanced performance when applied to filtering and 
pattern recognition. 

Given the common product functional, a respective 
cross-correlation can be immediately obtained as: 


fUg|r] = [ K f(t),g(t—7) > dt (4) 


This operation has been observed to yield interesting 
results in filtering and pattern recognition applications. 
When employed jointly with other multifunction opera- 
tions, the common product convolution becomes the real- 
valued Jaccard and coincidence indices [13], which have 





been verified to allow remarkable performance for tasks 
such as non-supervised classification and complex net- 
works representation and community enhancement |16, 
?, 18). 

As such, it becomes of particular interest to contem- 
plate the implementation of the elementwise common 
product, which provides the basis for a wide range of 
applications including those commented above, in elec- 
tronic hardware, which is addressed in the two following 
sections. 
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Figure 1: Two functions, namely a complete period of cosine (a) and sine (b), as well as their respective sign function s(c-d) and conjoint 


sign function (e). 


4 Electronic Implementation 


Interestingly, all the basic real-valued multiset operations 
presented in Section 2 can be ready and effectively im- 
plemented in analog circuitry though, as we will see, spe- 
cial attention is required regarding switching noise. Al 
the proposed circuit implementations in the remainder 
of this work are not immediately operational or particu- 
larly efficient, being mostly conceived from the didactic 
perspective and as a proof of concept of the possibilities 
proposed in the current work. 

Figure 3 illustrates a possible implementation of the 
sign function by using the electronic device known as com- 
parator, which basically corresponds to an operational 
amplifier optimized for fast switching. This is a classic 
basic circuit involving an operational amplifier [20, 3]. 


The intersection between signals f(t) and g(t) can be 
conveniently obtained by using an operational amplifier 
and an analog switch as illustrated in Figure 4(a), while 
the signal union can be readily obtained by swapping the 
operational amplifier inputs as shown in Figure 4(b). 


The absolute value of f(t), namely s f(t), can be easily 


obtained by employing an analog switch, a comparator, 
and an inverting amplifier, as illustrated in Figure ??. 


The conjoint sign function between the signals f(t) and 
g(t), illustrated in Figure 6, two comparators and an ana- 
log XOR gate. 


Another multiset operation that needs to be electroni- 
cally implemented concerns the here called signification, 
which consists of implementing the sign provided by a 
sign function sf into a respective function f(t). Observe 
that this operation can be understood as corresponding 
to the inverse of the absolute value operation. Indeed, 
the absolute operation on any signal f(t) followed by the 
respective signification will recover the original function 


f(t). 


5 Elementwise Common Product 
Implementation 


Having proposed preliminary respective electronic imple- 
mentations for several important multifunction opera- 
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Figure 2: Real-valued multifunction operations of intersection (a), union (b) of f(t) and g(t), and absolute value (c) respectively to f(t). 
The elementwise common product (Section 3) is shown in (d) together with the original functions f(t) and g(t). Observe that the common 
product corresponds to the regions of the two functions that are common while taking as reference the horizontal axis. 


t(t) 


Figure 3: The sign detection operation can be immediately imple- 
mented by using a comparator. 


tions, we are now in position to propose a complete de- 
sign of an elementwise common product operator, which 
is shown in Figure 8. This suggested design involves 
only three operational amplifiers, five comparators, for 
switches and an analogic XOR gate. 

This implementation is aimed mostly as a proof or con- 
cept, being by no means intended to be particularly opera- 
tional or effective. Indeed, much more efficient designs can 
be achieved at the level of more basic componentes such as 
transistors, especially when considering implementations 
in integrated electronics. 





f(t) min(f(t),g(t)) 
g(t) 








max(f(t),g(t)) 





(b) 


Figure 4: The intersection and union real-valued multiset opera- 
tions can be readily implemented by using an analog switch and 
an operational amplifier, both of which being standard devices in 
electronics. 


One aspect deserving particular attention regards the 
need to condition and control the high frequency switch- 





Figure 5: The absolute value operation sẹ f(t) can be implemented 
by using an analog switch, a comparator, and an inverting opera- 
tional amplifier. 
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Figure 6: The conjoint sign function sg can be obtained by com- 
bining two comparators and an analogic XOR gate. 





Figure 7: The signification operation takes an absolute value func- 
tion sf f(t) and recovers its respective signed original form f(t). 
Observe that, except for eventual electronic artifacts, the conjoint 





operator followed by the respective significator will have not effect 





on the input signal f(t), as these two operations are one the inverse 
of the other. 


ing noise implied by the four analog switches. This can be 
addressed by incorporating respective low-pass capacitors 





and related techniques, though at the probably expense 





of signal speed. Additional research is required before an 
operational version of the proposed implementation of the 
elementwise common product can be obtained. 


6 Concluding Remarks 


Electronics and signal processing have intensively relied 
on algebraic operations such as sums, subtractions and 
products between functions. 

The recent generalization of multiset concepts to take 
into account real-valued functions has paved the way to a 
wide range of possible new concepts, developments, and 
applications. 

In this work, we addressed the possibility to establish 
analogous implementations of each of the main multi- 
set /multifunction operations, including the sign and con- 
joint sign functions, the minimum (intersection) and max- 
imum (union) between pairs of signals, as well as the ab- 
solute value and the inverse operation of signification. 





These developments allowed us to propose a com- 
plete possible implementation of the elementwise common 
product, which is the basic element in the respective com- 
mon product and common product correlation between 
signals, all of which have been shown to have impres- 
sive potential for several applications such as in signal 
processing, patter recognition, deep learning, and control 
systems. 

Further developments include but are not limited to de- 
vising more effective and operational implementations of 
the elementwise common product, as well as circuits ca- 
pable of performing the common product and respective 
correlation. Particular attention should be given to con- 
trolling and conditioning the switching noised implied by 
the analog switches. Respective works are in development 
and the results should be communicated opportunely. 
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